Thermodynamics of the binary symmetric channel
نویسنده
چکیده
We study a hidden Markov process which is the result of a transmission of the binary symmetric Markov source over the memoryless binary symmetric channel. This process has been studied extensively in Information Theory and is often used as a benchmark case for the so-called denoising algorithms. Exploiting the link between this process and the 1D Random Field Ising Model (RFIM), we are able to identify the Gibbs potential of the resulting Hidden Markov process. Moreover, we obtain a stronger bound on the memory decay rate. We conclude with a discussion on implications of our results for the development of denoising algorithms.
منابع مشابه
Thermodynamic derivation of the mutual information for discrete symmetric channels
Abstract The mutual information for the binary symmetric channel as well as for the discrete symmetric channel consisting of 4-input/output (I/O) symbols is explicitly calculated using the generalized second law of thermodynamics which was recently proposed by the first two authors. For equiprobable I/O the mutual information of the examined channels has a very simple thermodynamic form as a fu...
متن کاملCarnot in the Information Age: Discrete Symmetric Channels
Modeling communication channels as thermal systems results in Hamiltonians which are an explicit function of the temperature. The first two authors have recently generalized the second thermodynamic law to encompass systems with temperature-dependent energy levels, dQ = TdS+ < dE/dT > dT , where < · > denotes averaging over the Boltzmann distribution, recomputing the mutual information and othe...
متن کاملWave Propagation in a Layer of Binary Mixture of Elastic Solids
This paper concentrates on the propagation of waves in a layer of binary mixture of elastic solids subjected to stress free boundaries. Secular equations for the layer corresponding to symmetric and antisymmetric wave modes are derived in completely separate terms. The amplitudes of displacement components and specific loss for both symmetric and antisymmetric modes are obtained. The effect of ...
متن کاملDevelopment of a novel method in TRMC for a Binary Gas Flow Inside a Rotating Cylinder
A new approach to calculate the axially symmetric binary gas flow is proposed Dalton’s law for partial pressures contributed by each species of a binary gas mixture (argon and helium) is incorporated into numerical simulation of rarefied axially symmetric flow inside a rotating cylinder using the time relaxed Monte-Carlo (TRMC) scheme and the direct simulation Monte-Carlo (DSMC) method. The res...
متن کاملFuzzy number-valued fuzzy relation
It is well known fact that binary relations are generalized mathematical functions. Contrary to functions from domain to range, binary relations may assign to each element of domain two or more elements of range. Some basic operations on functions such as the inverse and composition are applicable to binary relations as well. Depending on the domain or range or both are fuzzy value fuzzy set, i...
متن کامل